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FOREWORD 


This report presents the results of a 9-month study by Martin Marietta 
for the National Aeronautics and Space Administration's George C. 
Marshall Space Flight Center. The study was the second phase of Con- 
tract NAS8-34679, Development of an Autonomous Video Rendezvous and 
Docking System. It resulted in a physical laboratory simulation and 
the demonstration of a video guidance system. Significant benefits 
were obtained from previous related work under Martin Marietta IR&D 
Project D-11R. 
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SUMMARY 


The critical elements of an autonomous video rendezvous and docking 
system have been built and used successfully in a physical laboratory 
simulation. The laboratory system demonstrated that a small, inexpen- 
sive electronic package and a flight computer of modest size can ana- 
lyze television images to derive guidance information for spacecraft. 

In the ultimate application, the system would use a docking aid con- 
sisting of three flashing lights mounted on a passive "target*’ space- 
craft. Television imagery of the docking aid would be processed aboard 
an active "chase vehicle" to derive relative positions and attitudes of 
the two spacecraft. 

The demonstration system used scale models of the target spacecraft 
with working docking aids. A television camera mounted on a 6-degree- 
of-freedom (DOF) simulator provided imagery of the target to simulate 
observations from the chase vehicle. A hardware video processor 
extracted statistics from the imagery, from which a computer quickly 
computed position and attitude. Computer software known as a Kalman 
filter derived velocity information from position measurements. The 
filter also produced "synthetic measurements" that allowed dead reckon- 
ing when the docking aid was not visible. 

Tests with this system produced data that are in good agreement with an 
all-software simulation conducted previously. Although these tests es- 
tablished the viability of the measurement technique, the control sys- 
tem needs improvement to effectively use the measurements in guiding 
the chase vehicle to dock with tumbling target spacecraft. Further 
work is already scheduled to develop these improvements. 
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I. INTRODUCTION 


This study is the second phase of a contract to Investigate techniques 
that could be used in an autonomous video rendezvous and docking system 
for spacecraft. 

Under Phase 1, we identified several techniques that appeared suitable 
for such a system* defined the equations and algorithms these tech- 
niques would use, and evaluated video guidance control systems based on 
these techniques through computer simulation. 

To ensure that practical problems were considered, the simulation mod- 
eled not only the sensor but also methods for dealing with a number of 
practical problems, e.g., maintaining control when the target space- 
craft leives the guidance sensor field of view. The simulation also 
modeled the characteristics and limitations of practical spacecraft to 
reveal subtle incompatibilities that might otherwise go unnoticed. A 
mission model was uefined to serve as a basis for the simulation. 

In this model the ^hase vehicle is a general-purpose spacecraft for 
repair, refurbishment, and retrieval of other spacecraft. After it is 
deployed from the space shuttle, it must rendezvous and dock with the 
Long Duration Exposure Facility (LDEF), which, it is assumed, has been 
modified for this operation and is in a circuiar orbit at an altitude 
of 300 km. We refer to LDEF as the "target spacecraft" because, al- 
though a specific mission model was used for the simulations, it was 
intended that the guidance method be usable on a variety of spacecraft. 

Ip Phase 2 of the contract, we conducted a physical simulation of the 
best technique evaluated under Phase 1. This technique used a docking 
aid comprising three flashing lights mounted on the target spacecraft 
(Fig. 1-1). This pattern of lights uniquely defined both the relative 
positions and the relative attitudes of the two spacecraft. 

To simulate the entire operation from a range of 300 meters to contact, 
three target-spacecraft models were required,, Each model was built to 
a different scale and was used in a different part of the simulation. 
The smallest model was l/100th scale and was used for ranges greater 
than approximately 30 meters. A l/10th scale model was used to simu- 
late ranges between 3 and 30 meters. For the final seconds of the 
docking operation, a full-scale model of a portion of one side of the 
LDEF was used. 

To simulate the servicer spacecraft or "chase vehicle," we mounted a 
television camera on a 6-D0F simulator (Fig. 1-2). The simulation com- 
puter sent servo commands to position the camera so that the television 
image would correspond to the image seen by a flight camera on a real 
chase vehicle. Video processing electronics converted the imagery to a 
set of statistics that a computer can quickly analyze to determine the 
relative position and attitude of the two spacecraft. These statistics 
were transmitted to the simulation computer, which modeled both the 
activity of the simulated flight computer and the dynamics of the two 
spacecraft . 
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Docking Aid 
on Target 
(3 Lights in 
T Pattern) 



on Chase Vehicle 


Figure 1-1 Flashing- Light Docking Aid 


This report concentrates on Phase 2 of the contract and repeats very 
little of the information that was published in the Phase 1 final re- 
port. The reader will find it advantageous to read at least the first 
three chapters* of the Phase 1 report before reading the more technical 
sections of this report. 


> k 


1-2 



I 


ORIGINAL PAGE Is 
OF POOR QUALITY 



1-3 



II. 


CONCLUSIONS AND RECOMMENDATIONS 


A. PHASE 1 CONCLUSIONS WERE CONFIRMED 


The three-light docking aid and control system still appear oractical, 
although improvements are needed. 

Measurement accuracy was about twice as good in the physical simulation 
as in the software simulation performed under Phase 2. The improvement 
can be attributed to the use of a better camera than the software simu- 
lation modeled. 

This increased accuracy did not materially improve control. The system 
still has trouble docking with target spacecraft tumbling over 1000 
degrees per hour about the pitch or yaw axis. This problem underscores 
the need for the control system improvements that are planned under 
contract Phase 3. 


B. OTHER USEFUL INFORMATION WAS GAINED 

Although this study produced few surprises, it did produce valuable 

results : 

1) The modeling for the all-software simulation was in close agreement 
with reality. This fact increases the confidence that can be 
placed in the Phase 1 study results. Because the Phase 3 study 
will also use an all-software simulation, this confirmation of mod- 
els and assumptions is especially important. 

2) Improvements were made in portions of the simulation program: the 

image interpretation algorithm now handles singularities, some 
minor errors wer^ corrected, and dead reckoning was improved. 

3) The real-time image interpretation scheme was shown to be practi- 
cal, and we have a much better knowledge of the required size, com- 
plexity, and cost of the hardware it requires. 


C. SEVERAL TOPICS WARRANT FURTHER STUDY 


A third phase of this study will begin soon. In this phase the Kalman 
filter will be expanded tc estimate target tumble parameters, and im- 
provements will be made to the control system. Th^se changes should 
improve the system’s ability to deal with tumbling target spacecraft. 
However, several other topics should also be investigated. These top- 
ics are discussed briefly below. 
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Passive Docking Aid 


The present design requires the target spacecraft to flash its docking 
aid lights, which may cause problems in some applications. For exam- 
ple, if the mission is refurbishment or retrieval of ma1 r ’onlng 
spacecraft, there is concern over whether the lights wii, ope e after 
several years in orbit. 

If the lamps are replaced with corner-cube reflectors, the same three- 
point docking aid can be used with no change to the interpretation al- 
gorithm, but the target can be completely inactive. However, this nod- 
ification will make the chase vehicle system more complex. First, the 
reflectors will have to be illuminated. Supplying this illumination 
from the chase vehicle will require increased power. Second, some 
means will be required to distinguish among the three reflectors, be- 
cause the algorithm requires a knowledge of which light is which. 

Although we can envision methods for solving these problems, there are 
no test data to verify their practicality. For examp 1 e, colored fil- 
ters could be used to distinguish among the reflectors, but there are 
no data on how well a color camera could separate the three images, how 
much light would be required, or what wavelengths and bandwidths should 
produce the best results. 

A study of these problems and questions might result In a system that 
can be used in a wider variety of missions. 

2. Full-Scale Long-Range Test 

Useful data could be collected at low cost by running tests with the 
full-scale model's docking aid located outdoors, a full 300 meters from 
the television camera. Tests run at various times during the day and 
at night would establish how well the system copes with sunlit back- 
ground clutter and how effective a shutter would be in rejecting the 
background. In these tests, the docking aid would be moved manually, 
and no attempt would be made to simulate spacecraft dynamics or control 
algorithms . 

3. Acquisition Strategies 

The work to date has concentrated on what happens after the video sys- 
tem has taken control. If the system is to be practical, it must be 
able to initially locate the target spacecraft. Some effort should be 
spent in determining how It will do this. A complicating factor is 
that a tumbling target 1 s' docking aid may be visible only intermittently. 

4. Camera Mounting 

In the present system, the television camera is mounted rigidly to the 
chase vehicle. This causes no problems at long range, but in the last 
few meters before contact far too much fuel is used in attitude maneu- 
vers simply to keep the docking aid within the camera's field of view. 

It is posable that a gimballed camera could save more than enough fuel 
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to pay for itself • However, we do not presently have enough informa- 
( tion to draw this conclusion, 

\ 

If the camera is gimballed, the control system will need to be modified 
to include logic for gimbal control and for determining when attitude 
maneuvers are required, 

5. Multiple Docking Aid s 

If a target is tumbling, the docking aid may be visible infrequently or 
may be invisible from the chase vehicle’s position. Adding one or two 
redundant docking aids to other sides of the target spacecraft would 
solve this problem. If the lamps are controlled from the chase vehi- 
cle, as they are in the present control system, the guidance algorithm 
could simply select the docking aid that is most easily viewed. 


III. 


SIMULATION RESULTS AND DISCUSSION 


A. THE SYSTEM PERFORMED AS EXPECTED 


The camera used for tb^ physical simulations is slightly better than 
the camera modeled in the software simulation. The real camera hap a 
resolution of 188 television lines horizontally by 122 vertically* and 
the software model assumed 128 by 128. Also, the real camera used a 
somewhat smaller field of view, whirh made the docking aid larger in 
the television images. We therefore expected improved accuracy from 
the physical simulation, but not a great deal of improvement. 

The test results (Table III-l) confirmed these expectations. The posi- 
tion errors in the all-sofcware simulation varied from 47 percent at 
300 meters down to 3 percent at 20 meters. In the physical simulation, 
the corresponding errors were typically between 9 percent (on the dock- 
ing axis') to 19 percent (60 degrees off the docking axis) at 300 meters 
and 1.5 to 2,5 percent at the 20-meter range. 


Table III- 1 Position Measurement Error 


Range 

(Meters) 

Error 

(Standard Deviation 
As Percent of Range) 

Conditions 

Camera 

Moved? 

Light Orientation 

in Image 

(H = Horizontal, 

V = Vertical) 

Approx. Distance 
from Docking Axis 
(Degrees) 

307 

10.91 

No 

V 

0 

298 

5.94 

Yes 

H 

0 

293 

7.27 

No 

H 

0 

212 

13.11 

No 

H 

60 

162 

0.98 

No 

H 

0 

160 

2.23 

No 

V 

0 

99 

7.39 

No 

H 

60 

95 

9.39 

Yes 

II 

60 

91 

4.37 

Yes 

H 

0 

58 

1.58 

Yes 

H 

0 

15 

1.26 

Yes 

1 H 

0 

13 

0.46 

No 

H 

0 

9 

0.51 

Yes 

H 

60 

8 

0.69 

iS 

H 

0 

8 

1.04 ; 

No 

H 

60 

5 

0.28 1 

No 

H 

0 

4 

2.23 

No 

H 

o 
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Table 1II-2 shows the errors in the measurements of the camera's posi- 
tion in the target spacecraft's coordinate system. These measurements 
are not used to estimate the chase vehicle's "state" vector; they are 
used only to determine the target's attitude. Thus, even gross errors 
are of little consequence at distances over 40 meters. 


Table III- 2 Errors in Measurement . Used to Determine Target Attitude 


Range 

(Meters) 

Error 

(Standard Deviation 
As Percent of Range) 

Conditions 

Camera 

Moved? 

Light Orientation 

in Image 

(H * Horizontal, 

V * Vertical) 

Approx. Distance 
from Docking Axis 
(Degrees) 

30/ 

17.26 

No 

V 

0 

298 

26.95 

Yes 

H 

0 

293 

12.43 

No 

H 

0 

212 

31.29 

No 

H 

60 

162 

2.75 

No 

H 

0 

160 

5.04 

No 

V 

0 

99 

8.42 

No 

H 

60 

95 

28.61 

Yes 

H 

60 

91 

7.57 

Yes 

A 

0 

58 

7.23 

Yes 

H 

0 

15 

6.77 

Yes 

H 

0 

13 

4.08 

No 

H 

0 

9 

3.12 

Yes 

H 

60 

8 

2.53 

Yes 

H 

0 

8 

9.44 

No 

H 

60 

5 

1.19 

No 

H 

0 

4 

5.04 

No 

H 

0 


The error tests were performed two different ways. For the first ser- 
ies of tests, we placed the camera at selected positions and took ap- 
proximately 12 measurements at each position without moving the camera 
between measurements. In the second series of tests, the camera's at- 
titude was changed slightly between measurements so that no lamp's 
image appeared twice at the same place in the picture. We found no 
consistent difference in the error magnitude, but errors in the second 
series were never below 0.51 percent. 
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The measurement errors listed In both tables represent "noise 1 * or ran- 
dom variations In the measurements, rather than the deviation from co- 
ordinates defined by theoretical arguments. We felt the "noise" level 
was more useful and more meaningful for four reasons: 

1) In working with the small model, we found that our eyes were not 
nearly as good as the video system in determining where the theo- 
retical docking axis was. The most accurate way to align the model 
and simulator coordinate systems was to use the video processor. 
Further, an error of only two degrees in positioning the model 
could result in an apparent error of over 10 (scaled) meters at the 
maximum range. We could easily observe such a bias in the data, 
but we could not estimate model angles that accurately. 

2) In a flight system, such biases can be eliminated in calibration. 

1) For the anticipated applications, an error of one or two degrees In 
determining the location of the docking axis will he of little con- 
sequence as long as the system is consistent, hut random errors 
will degrade system performance. 

'O When the camera was close to the model, the biases were dominated 
by factors Irrelevant to a flight system, such as simulator servo 
errors, a shift of a millimeter >r a degree In positioning models 
between simulation phases, etc. 

The ultimate performance of a flight system is not necessarily limited 
to what we achieved In the simulation. A camera with better resolution 
would certainly help. 


B. TRAJKCTOKIHS Dll) NOT CHANCK 


The trajectory ph>ts from the physical simulation were indistinguish- 
able from those produced with the all-softwace simulation. The control 
system appeared to have the same limitations In working with tumbling 
targets, and, as before, the problem was not in measurement accuracy 
but In the control algorithms. 

Figures lil-l through III —A illustrate typical performance with iner- 
tially stable targets and with targets tumbling at various rates about 
their principal axes. In many cases we could not determine whether the 
docking would he successful, because the simulator reached the limit of 
Its travel and the simulation had to he stopped. For example, a target 
with a high yaw rate can turn 90 degrees before the chase vehicle gets 
close. To simulate the end-on view that the chase vehicle would have 
of the target, the simulator would have to position the camera outside 
the room or possibly outdoors. However, the close agreement between 
the all-software simulation and the physical simulation with low-atti- 
tude rates strongly suggests similar agreement at higher rates. 
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(a) (b) 


•#(- ffi- ^ l^o 


(c) (d) 



i 



Note : 

(b) is a closeup of (a); in (a ) , a servo command limit was reached, 
stopping the simulation. All simulations looked good as far as they 
went. 

Figure III-l Typical Trajectories with Inertially Stable Targets 
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(a) 240 degrees/hour (b) 500 degrees /hour 


'x 

X 

/ 

7 


~ ~ ~ “7 

» 

— 

¥ 



X 

V 

\ 

\ 

_S| 

A 



(a) 2000 degrees/hour 


(d) 10,000 degrees /hour 



Note : 

All but (a) stopped when servo limit was reached. The system appears 
well behaved up to 10,000 degrees/hour. 

i 

Figure III-2 

Trajectories with Various Target Tumble Rates about the Roll Axi » 
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(a) 240 degrees /hour (b) 500 degrees/hour 
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(a) 1000 degrees/hour (d) 2000 degrees/hour 



Note : 

All but (a) stopped in simulation Phase Two because servo limits were 
reached. At 2000 degrees/hour, the chase vehicle could not keep the 
target in view, but (a) looked good as far as it went. 


Figure III- 3 

Trajectories with Various Target Tumble Rates about the Pitoh Axis 
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(a) 240 degrees /hour 


(b) 500 degrees/hour 
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(c) 1000 degrees/hour 


(d) 2000 degrees /hour 



Note ; 

Runs (e) and (d) reached simulator servo limits in simulation Phase 
Three. The chase vehicle was not out of control in any of these runs, 
although it overshot the docking axis in (d). 


Figure I II - 4 

Trajectories with Various Target Tumble Rates about the Yaw Axis 
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IV. LABORATORY MODELS AND HARDWARE 


The laboratory equipment for the simulation included scale models of 
the target spacecraft with working docking aid lights and a television 
camera mounted on a 6-DOF simulator (Figures IV-1 and IV-2). Video 
processing electronics (described in Chapter VI) extracted information 
from the television images to send to the simulation computer. 



\# 


Figure IV-1 Simulation Camera with Small Target Model 


A. THREE SCALE MODELS WERE USED 


Each simulation started at a simulated range of approximately 300 me- 
ters, and a l/100th scale model was used. When the simulated range 
reached approximately 30 meters, the computer interrupted the simula- 
tion to allow the operator to switch to the l/10th scale model. The 
camera then moved away from the model to simulate the position where it 
left off, but at a scale of 1/10. Similarly, there was a switch to the 
large full-scale model for the final seconds of the simulation. 
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Figure IV-2 Simulator with All Three Target Models 


The use of three models provided increased detail at close range and 
reduced the effects of camera positioning tolerances on the simulation 
results. It also reduced problems with lens characteristics. Because 
the camera used a compound lens, it was' difficult to pinpoint the spot 
along the optical axis that should be considered the camera’s "loca- 
tion." When the scale of a simulation is 1/1, this is not much of a 
problem because the error will be only about 1 centimeter. But when a 
l/100th scale model Is used, the uncertainty approaches 1 meter. This 
is a significant fraction of the caraera/lamp separation near the end of 
the simulation. Also, the lens has a minimum focusing distance. Al- 
though we found that measurement accuracy did not suffer greatly with 
images moderately out of focus, we would not trust data taken with the 
lens almost touching the model. 

The models represented the Long Duration Exposure Facility, modified to 
include a nonimpact docking fixture, and the docking aid, which was 
mounted in two of the experiment trays. The other trays did not model 
specific experiments; they were simply an artist's conception of what 
a typical payload might look like. 


IV-2 


ORIGINAL PAGE IS 
Q£ POOR QUALITY 


Different construction techniques were used for each model. The large 
model was made of muslin stretched over wooden frames, much like a prop 
for a stage play. In the plane perpendicular to the docking axis, the 
model was full scale, but dimensions along the docking axis were short- 
ened by 50 percent, except for the docking aid. Only a small portion 
of one side of the spacecraft would fit into the room, but the model 
was large enough to fill the camera's field of view. The three flash 
lamps were directly visible in this model. 

The medium-scale model (Figure IV-3) was made of balsa wood and Gator- 
boaid , a paper-covered foam material. The flash lamps were inside the 
model, and light was transmitted from the lamps through Lucite rods to 
the outside. The ends of the rods were rounded and sanded so that the 
transmitted light would radiate in all directions from the end. The 
rods were enclosed in metal tubes so tnat light could not be seen from 
any part of the rod except the end. Because the rod stock was l/10th 
the diameter of a flash lamp, the rod end looked very much like a mini- 
ature lamp. 


i V 

I 

l ^ 


Figure IV- 3 Medium-Scale Model 
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The small model (Fig. IV-4) was also made of Gatorboard. Because it 
was too small to hold the flash lamps, the lamps were placed in a 
light-tight box near the model, and the light was transmitted through 
the model with fiber-optic cables. Because the diameter of the trans- 
parent core of the fiber optic cable was approximately l/100th the di- 
ameter of a flash lamp, the roughened end of the cable was used as a 
subminiature ’’lamp," and the jacketed part of the cable served as its 
support rod . 
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B. 


CAMERA REPRESENTED CHASE VEHICLE CAMERA 


Because the chase vehicle does not appear in the camera’s field of 
view, no scale model of it was required. In the software simulation, 
performed under Phase 1, the camera was not a9 far forward as it was 
for this simulation, and part of the chase vehicle structure would have 
appeared in the field of view. We found that in correcting this prob- 
lem, we introduced another: the field of view had to be wide enough to 

allow the camera to see, from its new position, all three lights on the 
docking aid In the last few seconds before contact. When we Installed 
a wide-angle lens, the image of the docking aid at a simulated range of 
300 meters was too small for satisfactory operation of the video elec- 
tronics because the lamp did not produce enough voltage in the video 
signal. The ’’normal’’ lens for the camera, which had twice the focal 
length, proved quite satisfactory at this range. 

It is difficult to judge how much of this problem is due to the way the 
models are built; a flight system might not have the problem. How- 
ever, if It does prove necessary to use two focal lengths in the flight 
system, a lens turret could be used to switch lenses, or two separate 
cameras could be used, each with a lens of fixed focal length. 

This problem might also be solved by using a different camera technol- 
ogy. The simulation camera was a charge-injection device (CID)* and 
its noise level was only about a factor of 40 below its saturation 
level. Charge-coupled devices (CCD) with considerably better charac- 
teristics are available, and both technologies have improved since our 
camera was manufactured. 

The CID camera has one feature that is very useful in this applica- 
tion: it can cope with images whose brightness is far above the satu- 

ration level without "bleeding” from the bright spot into other parts 
of the picture. Such an image on a CCD camera may cause an entire col- 
umn of the image, or even the whole image, to turn solid white. Fur- 
thermore, the CID camera does not have the after-image problem that 
other types of cameras have. 


C. SIMULATOR POSITIONED THE CAMERA 


The characteristics of the simulator we used are summarized in Table 
IV-1. Its characteristics determined, in part, what could be simu- 
lated. For example, because the model did not move during the simula- 
tions, the simulator could not place the camera in a location to simu- 
late an initial target yaw of 90 degrees; the camera would have to be 
outside the room. Similarly, there were times during a simulation at 
which an unrealizable position was required, and the simulation had to 
be terminated. In general, this occurred only with high target atti- 
tude rates; thus, it was possible to simulate a wide variety of 
conditions. 
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Table IV- 1 Simulator Characteristics OF POOR t jALITY 



Axis 

X 

y 

z 

Yaw 

Pitch 

Roll 

Travel 

4.56 m 

1.84 m 

2.99 m 

3.19 rad 

3.18 rad 

6.50 rad 

Speed 

9.1 cm/s 

8.7 cm/s 

7.9 cm/s 

3 mrad/s 

3 mrad/s 

3 mrad/s 


The simulator was controlled by analog position command voltages from 
the computer. Because the simulator used position servos, the timing 
of the commands was not critical. If the computer did not respond 
quickly, the servos simply held the camera until the computer was ready. 
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GUIDANCE SYSTEM S 


CENTROID DETECTCR ALL DIGITAL 


The video 1 g electronics uses a digital implementation of the 

centroid-.'^ ' ’ r algorithm described in Chapter IV of the Phase 1 
finaj re- found that an analog implementation '.annot cope with 

the ox t l ■ . , JMmic range in the data it must process for a full ren- 

dezvous .kUk. cocking operation. The centroid calculator’s integrators 
must, for example, handle images in which the image of a flash lamp is 
in the ce 'tor of the image and fills a miniscule fraction of the field 
of view,. It must also handle the case in which a flash lamp’s image is 
in the corner of the television picture and f’lls an appreciable frac- 
tion of the field of view. The ratio of two of the integrators’ out- 
puts in the latter case to their outputs in the former case can be 
50,000:1. If the nois<^ level is to remain below 10 percent of the sig- 
nal over this dynamic range, the integrator must provide a signal-to- 
noise ratio of approximately 130 decibels. It is not practical to 
build such an integrator with analog circuitry. 

The dynamic range could be made manageable if the camera used a zoom 
lens, but this solution introduces other complications. First, the 
zoom lens would need some kind of servo to control it. Second, using a 
lens of long focal length at the start of the rendezvous operation 
would greatly complicate acquisition and tighten attitude control re- 
quirements. We concluded that the digital approach would result in 
minimum system cost for a given level of performance. 

The digital circuit uses "thresholded" video: the circuit converts 

portions of the picture, where the signal voltage is greater than a 
reference value, to pure white. All other portions of the image are 
converted to pure black. Thresholding has both advantages and disad- 
vantages, Among the advantages are: 

1) Improved rejection of background clutter; only the flash lamps will 
be visible in the image, 

2) Simpler electronics; multiplication of the video by the deflection 
is reduced to a gating operation. 

3) Potential adaptation to adverse lighting conditions; the computer 
could adjust the reference voltage until the white area in the 
image matches expectations for the estimated viewing position. The 
system might be able to cope with unexpected sun glint from a shiny 
surface by using this approach. 

The main disadvantage is the all-or-nothing nature of the calculation. 
If the lamps are not as bright as a shiny part of the target space- 
craft, they might be ignored altogether. Usually this situation will 
be detected for two reasons. First, the system always examines an 


image Ln which no lights are flashing and subtracts the values it re- 
ceives from the video electronics on this frame f^om the values it re" 
ceive3 on all other frames. Because the no-lamp image does not have 
time to change much between measurements, the resultant lamp area in 
the image will usually be cloce to zero or may be negative. The image 
interpretation algorithm can detect this kind of error and ignore the 
measurement. Second, even if the data masquerade as legitimate data, 
the image interpretation routine will generally , rovide a position 
measurement that is grossly different from what the Kalman filter is 
expecting. If the filter receives such a measurement, it will ignore 
it. However, to minimize the problem, the target spacecraft should not 
have shiny surfaces near the flash lamps. It would also help if the 
camera were equipped with a shutter that opens only during the flash. 

A shutter can reduce background clutter by a factor of 30 without at- 
tenuating the flash. 

The digital implem3ntation of the algorithm appears much more complex 
chan the analog version, but it consumes only about twice the circuit 
card area. The algorithm and circuit details are discussed in Chapter 
VI. 


B. IMAGE INTERPRETATION WAS IMPRCvED 


In the all-software simulation developed under Phase 1 , image corrup- 
tions were simulated by adding random numbers to lamp-image coordi- 
nates. Because this approach mode singularities highly unlikely, the 
scene-analysis subroutine (POSIT) did not thoroughly check for them. 

When the subroutine was used with real imagery, we found that these 
singularities occur several times during a docking operation, because 
the television image comprises a finite number of lines and columns. 

The subroutine can no longer ignore the possibility that two lamps will 
lie on the same horizontal or vertical line in the image. 

The improved version of subroutine POSIT tests for singularities. When 
it finds one, it uses an alternate formula to interpret the image 
Because the alternate formulas are derived from the normal formula by 
extracting limits, we will first consider the normal forrau' . 

Subroutine POSIT calculates the position of the chase vehicle in the 
docking aid’s coordinate system (Fig. V-l), Some simplification can be 
gained by working with image-plane quantities that are independent of 
camera rotatiou about the line of sight. Figure V -2 illustrates the 
set of quantities used in the formulas in the subroutine. These quan- 
tities can be measured on the image and can be defined in terms 01 the 
image-plane coordinates of the three lamp images, (u*[,vi), 

(u2,V2>, and (113^3): 


V -2 



a* Is half the length of the line connecting (uj^vi) to (113^3); 


b' is the length of the line that connects (112^2) to the midpoint, 
( u m> v ra)> between (u l 9 v l ) and (u 3> v 3 ); 

(u c , v c ) Is a point on the line between (u 3 ,v^) and (113^3) 
at which a perpendicular to that line passes through (u2,V2); 

h is the length of the line connecting (u c ,v c ) with (u2,V2)* 



Television Camera 
on Chase Vehicle 


Note : 

Subroutine POSIT computes the vector £ from an analysis of the video 
imagery. The lengths a and b are 1 meter in the simulation, but the 
formulas do not require any specific lengths as long as a and b are 
known. 

Figure V-l Definition of Docking Aid Coordinate System 



Figure V-2 Image-Plane Quantities Used for Analysis 
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The length a* is found by the Pythagorean theorem: 


a' = 0.5 /(u 3 - ui) 2 + (v 3 - vx) 2 . 

The slope of the line connecting (uj^v^) to (u3,\ T 3) is 

V 1 - v 3 

s =■ . 

u l — u 3 

The slope of the line of length h is 
s " = -1/s . 

Thus, the equations of the latter two lines are 

v = s(u - u^) + vi 
and 

v = s ^ (u - u 2 ) + v 2 • 

The intersection is found by setting these expressions 
each other: 

s(u c - Ui) + Vj = s'(u c - ll 2 ) + V 2 , 
which can be manipulated to give 

v 2 - V 1 + su\ - s"u 2 

u . 

c s - s 

If u c substitutes for u in Eq 5 , 

v = s"(u - u 2 ) + v 2 , 
c c *- 

Vtow h can be computed by the Pythagorean theorem: 
h = 7(u c - u 2 ) 2 + (v c - v 2 ) 2 . 

Similarly, 

h' * 7(v m - v 2 ) 2 + (u ffl - U 2) 2 . 
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for v equal to 


where v m - (vi + v 3 )/2 and u m = (ui + u 3 )/2 • 
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We now have formulas for a ? , b 1 , and h in terras of Lamp coordinates in 
an image* Furthermore, these formulas are accurate in spite of any 
rotation about the line of sight except at a few singu’arlties, which 
we will dUcuss later. 


Now consider the three orthographic projections shown in Figure V-3. 

The arrow is a unit vector that points to the observer. The coordi- 
nates of its tip in the docking-aid coordinate system a^e (-x,-y,x), 
where the minus signs are used to make all the quantities positive. 

The orthographic projection, in which the vector appears as a point, 
will approximate what the television camera sees. The image is only an 
approximation for two important reasons: 

1) It is too large, by the ratio r/f, where r is the distance from 
camera to target and f is the camera lens focal length. This fact 
will be used to advantage in calculating range. 

2) It Ignores perspective effects. The image distortion from perspec- 
tive effects becomes significant at close range. However, in prac- 
tice the error in image interpretation caused by ignoring the ef- 
fects is small. 
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The projections of Figure V-3 were produced by graphical construction. 
All the labeled dimensions can be determined from the drawing by find- 
ing similar triangles, noting that x* + y 2 + z 2 * 1, and applying 
the Pythagorean theorem. These techniques provide the following formu- 
las for a* , b' , and h: 

[11] a' = a /x 2 + z 2 ; 


[12] b' = b J y 2 + z 2 ; 


[13] h = bz/ J x 2 + z 2 ; 


where a and b are the distances on the target spacecraft whose projec- 
tions are the lines labeled a* and b 1 in Figure V-3. In the simula- 
tion, a * b = 1 meter, but the formulas do not require any particular 
values. 

If we define 

( a^b) 2 = x 2 + z 2 

[U] °-(ab') 2 y 2 + z 2 » 

then by substitution, we can define 

|15| t . - i_t_d _ 

2h y D 2z 

which relates a set of observable quantities to the observer's posi- 
tion. From this definition,. 

[16] z 2 - 2kz + 1 = 0, 

which can be solved by the quadratic formula to give 

[17] z = k - 7k 2 - 1. 

Then substitution gives expressions for the other observer coordinates: 




i 
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[19] 


y 
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1 - Dz* 


1 + D 


Now ( x y z ) c is a unit vector in the direction of the observer if 
the signs of x, y, and z prove correct; all the squaring and extract- 
ing of square roots have destroyed sign information, Wc will now re- 
store the °igns. 

First, note that the formulas for x and y sT-vsys give a positive an- 
swer. The formula for z also gives a positive answer, although it is 
less obvious. We can therefoie simply multiply the vector elements 
that should be negative by -1.0. 

The x component will always be negative, because the lights cannot be 
seen if the observer's position has a positive x component: the target 

spacecraft will be in the way. We can therefore unconditionally multi- 
ply the x component by -1.0. 

The y component should be negative if the center light appears closer 
to the right-hand light than to the left-hand light in tie television 
image. The lamp-image separations can be computed by the Pythagorean 
theorem; the y component should be negative if 

[20] / (ui - u 2 ) 2 + (Vi - v 2 ) 2 < /(U3 - u 2 ) 2 + (v 3 - v 2 ) 2 . 

We can save some computation by comparing the squares of the lengths 
rather than the lengths themselves: 

if (ui - u 2 ) 2 + (v! - v 2 ) 2 < (U3 - u 2 ) 2 + (v 3 - v 2 ) 2 let y * - y • 

To test for a negative z component, the computer need only decide 
whether the center light appears above or below the line joining the 
other two lights. However, the definitions of above and below should 
not change if the camera rotates about the line of sight. The test 
used in subroutine POSIT is the sign of the nonzero component of the 
cross product of two vectors. The first vector is a line from the left 
lamp to the right lamp in the image. The second vector is the line 
connecting the point (u c ,v c ) to the center-lamp image (u^v*). if 
the third compenent of 


[ 21 ] 


u 3 " u l“ 


_u 2 " U c 

v 3 - vi 

X 

v 2 - v c 

0 _ 


_ 0 _ 
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is positive, the center light is above the line joining the two side 
lights, no matter how the camera is rotated. This test can be rewrit- 
ten as 

if (U3 - ui)(v 2 - v ) > (v 3 - Vi)(u 2 - uj let z ■ - z • 

If we can compute the distance from the docking aid to the camera, we 
can compute the camera's coordinates by multiplying x, y, and z by this 
distance. Recall that the construction in Figure V-3 makes the image 
larger than what the camera sees by a factor of r/f, where f is the 
known lens focal length a" :1 r is the docking -aid-to-c amera distance we 
are seeking. 3ecause a' in the figure is a 7 x 2 + z , 

[ 22 ] r = a / x2 + z2 

f a' 

or 


a y x 2 + z 2 f 
[23] r 

a' 


Thus, the camera’s position in a coordinate system centered at the base 
of the docking aid is 


[24] 


xr 

yr 

zr 


The remainder of the simulation program needs to know the position in a 
coordinate system whose origin is at the center light. The difference 
is simply adding b to the x component of the position: 


xr + b 


[25] 


yr 

zr 


The formulas in subroutine POSIT are exactly those we have just dis- 
cussed, but with the notation differences shown in Table V-l. 
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Table V-l notation in Subroutine POSIT 0F poor quality 


Notation in Formulas 

Notation in Subroutine 

ci) b ) h ^ 0 ) S) u ) v 

[Same as Formulas] 

x, y, z 

XP, YP, ZP 

r 

RHO 

s', a', b' 

SP, AP, BP 

u , V , U , V 

m nr c c 

UM, VM, UC, VC 

k 

AK 

f 

FOCLEN 

[Final Position Vector] 

RELPOS 


Up to this point, we have ignored several possibilities that could re- 
sult in division by zero when a computer tries to solve an equation. 
Subroutine POSIT uses the formulas we just derived, unless it detects a 
condition that would lead to division by zero. These formulas are pro- 
vided in Appendix A between statement 20 and statement 30 and in all 
statements after statement 60 of subroutine POSIT. 

The rest of the subroutine tests for perverse cases (s»0, h*0, a'«0, or 
b'**0) and uses alternate formulas. These formulas are derived from the 
basic formulas by extracting the limit as some parameter approaches a 
critical value. All the formulas are therefore equivalent to those 
derived here. 

For example, if u^ * 03 , 

[26] a' « 0.5 /(u 3 - u t ) 2 + (v 3 - v ^ 2 - 0.5 |v 3 - v 3 1 , 


which results in a simpler formula for a', but 

vi - v 3 v 1 — v 3 

[27] , 

Ui - u 3 0 

which would be an error. However, we can s^ji itute the expression for 
s into each subsequent formula where s is used and extract the limit as 
UJ approaches U 3 : 

-(uj - u 3 ) 

- 0 , 


[28] s' 


vi - v 3 




V 1 - v 3 
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[ 29 ] 


v 2 ~ v i + 


ui " U3 


ui 


vi - v 3 


U 1 - u 3 


[30] 


/vi - v 3 \ 

u c - (V2 _ v l)(ui _ u 3 ) +l - v — — 1 U! . 


The limit as approaches 113 is 


[31] u 


/ v 1 - v 3 
c \ vi - v 3 


U 1 


or 

[32] u c * U! . 

Similarly, 

[33] v c ■ vi , and 
and 

[34] h * |ui - u 2 | . 

There is one situation in which nothing can be done: if all the lamps' 

images are at the same point, the subroutine cannot determine anything 
except the direction to the target. In this case, the subroutine re- 
turns a default set of coordinates so that processing can continue. 
These coordinates are subsequently thrown out by the Kalman filter so 
they do not affect navigation. 


C. THE KALMAN FILTER HAS TWO IMPROVEMENTS 


The Kalman filter has been changed very little from the original imple- 
mentation reported in the Phase 1 final report. The state variables 
are still the three-position and three-velocity vector components, and 
the reference frame is still the nonrotating "primary" reference frame, 
which is centered at the target spacecraft's center of mass and aligned 
with the chase vehicle's body coordinate system at the moment the video 
guidance system takes control. The filter is still used to derive ve- 
locity from position measurements, to improve estimates of position, 
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and to allow dead reckoning when the camera cannot observe the docking 
aid. 

Only two changes have been made: the filter now rejects "unreasonable” 

data, and the algorithm used for dead reckoning for attitude control 
has been completely revised. 

Reasonableness Check 

The original Kalman filter weighted each measurement: according to the 
confidence it had in the measurement versus the confidence it had in 
the position estimate provided by its mathematical dynamics model. It 
did not check measurements for reasonableness , so a single measurement 
that was orders of magnitude off could turn its estimates into complete 
nonsense. Because reflections from shiny surfaces and similar problems 
may occasionally produce faulty measurements, we added a te3t that 
throws out data that grossly disagree with the mathematical model. 

Along with the state estimate, the model computes the likely error in 
the estimate. The error information is in the form of a covariance 
matrix, P. The diagonal elements of P correspond to the variance, or 
the square of the standard deviation, of each of the state elements. 
Matrix elements off the diagonal indicate how errors in one state ele- 
ment correlate with other elements. For example, if P(l,2) is posi- 
tive, it indicates that elements 1 and 2 of the state estimate vector 
tend to have errors that are off in the same direction: if one is too 

high, the other probably is also too high. If P(l,2) Is negative, the 
errors in the two elements have the opposite relationship. If one ele- 
ment is too high, the other is probably too low. 

A simple scalar test does not take these interrelationships Into ac- 
count; the filter uses a more complex test that does. To test a meas- 
urement, subroutine INCORP computes 

c = (m - e) C P *(m - e) » 


where m is the measured position vector and e^ is the estimated posi- 
tion, the first three elements of ESTATE. The scalar c is a measure of 
how the error compares with the expected error. 

If the errors have a Gaussian distribution, values of c greater than 
2.4 can be expected about half the time, and values greater than 11.3 
can be expected about 1 percent of the time. The subroutine throws out 
measurements that produce values of c greater than 16. In normal oper- 
ation, such errors should occur only once or twice In a docking 
operation. 

In practice, we find that these errors occur more often because the 
distribution is not Gaussian. However, the largest number of thrown- 
out measurements occurs at the switchover from one scale target model 
to the next at the end of a simulation phase. No matter how carefully 
we aligned the models, we could not align them accurately enough to 



keep the filter from detecting the difference, because the filter’s - 

state estimates at the time of the switchover are very good and the P ( } 

matrix reflects their accuracy. The filter usually throws out several v , 

measurements before the probable error in its estimates increases 
enough to allow it to accept new measurements. 

This problem introduces a philosophical question: should the computer 

program faithfully represent flight software, or should it be adjusted 
to accommodate the shortcomings of a physical simulation? We chose to 
allow the system to reject a few measurements. The decision does not 
appear to affect control system operation significantly because the 
misalignments are small. 

2. Dead Reckoning 

We completely revised subroutine ESTRPY. Thir subroutine allows atti- 
tude control when the chase vehicle cannot observe the docking aid. 

Its output is a vector of pointing errors, RPYERR. 

The first element of the vector is the roll error. ESTRPY always re- 
turns a value of zero for this element, because it has no rational 
basis for estimating roll errors. The effect of returning a zero is 
that the chase vehicle will not attempt any roll corrections. 

To compute pitch and yaw errors, which are the next two vector ele- 
ments, ESTRPY first computes a unit vector (expressed in the chase ve- 
hicle's coordinate system) that points to the target: 

[36] _r = -A^e/ | ej , 


where 

£ is the unit vector; 

A c (represented in the program as ACV) is the direction cosine matrix 
that describes the chase vehicle's attitude with respect to the "pri- 
mary" reference frame; 

e^ is the first three (position) elements of the state estimate vector 
ESTATE. 

The projection of this vector onto the chase vehicle's y-z plane pro- 
vides a synthetic "image" of the target from which yaw and pitch errors 
can be estimated: the pitch error is ATAN2( r 3 ,ri) , and the yaw 

error is ATAN2(-r2»r^) , where ATAN2 is the FORTRAN two-argument arc 
tangent function. 

The values calculated by this method are only approximations, but they 
are adequate to get the target back into the field of view. 


\ 
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D. 


ERRORS IN THE SIMULATION PROGRAM WERE CORRECTED 


Two errors were found in the simulation program used in Phase 2. Nei- 
ther error alters the control system's performance enough to change the 
study conclusions. 

The first error was a typographical error in subroutine QUATRN. In the 
formula for the variable QT(2), one subscript was wrong. This caused 
errors in measurements of the target spacecraft's attitude. 

The second error was in the computation of "true" chase vehicle atti- 
tude. Subroutine LPRIME implemented a formula that was simply wrong. 
The error was introduced during a program modification to change the 
coordinate system used to express angular momentum. Its effect is a 
small fictitious torque on the chase vehicle. Because the magnitude of 
the torque is only about 1 percent of the torque from the thrusters, 
the error caused no observable change in spacecraft behavior. The cor- 
rection affects subroutine LPRIME and the line in subroutine STPRIM 
where LPRIME is called. 
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VI. VIDEO PROCESSING ELECTRONICS 


A. OVERVIEW 


The video processing electronics (Figure VI-1) implements the cen- 
troid-calculation portion of the algorithm described in Chapter V. Its 
inputs are video imagery from a television camera mounted on the simu- 
lator and control signals from the simulation computer. It produces 
numbers from which the computer can calculate the location of a flash 
lamp's image in the television picture. 



Figure VI-1 Video Processing Electronics 


The television camera used in the simulation divides an image into 
45,872 tiny spots of light arranged as a rectangular array of 244 lines 
by 138 columns. (Although there are 244 lines, the vertical-axis reso- 
lution is only 122 lines, because the detector elements are rescanned 
to create a signal compatible with standard video monitors.) The cam- 
era senses the average brightness of each spot of light and produces an 
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electrical voltage that is proportional to the brightness* It cannot 
detect image details within a spot; it can measure only the average 
brightness of the spot as a whole* The spots are called "picture ele- 
ments," or "pixels" for short. 

The camera ’’scans" what it sees, much as a reader scans a page of 
text. It starts in the upper left corner of the picture and, reading 
from left to right, sends the voltage for each pixel in the top line to 
the video processing electronics, one at a time. Along with the pixel 
voltages, it sends a logic signal called the "pixel-rate clock, * which 
is a series of pulses, oe for each pixel. The video electronics uses 
these pulses two ways. First, the pulses tell the electronics exactly 
when each pixel is sent, so the electronics does not miss any pixels or 
examine any twice. Second, by counting the pulses, the electronics can 
keep track of the current column number. After the first line has been 
sent, the camera begins sending the second line, and so on. At the 
start of each line, the camera sends a second logic signal called the 
horizontal sync pulse, which helps the electronics identify the first 
pixel in each line. Similarly, just before the first line, the camera 
sends a third logic signal called the vertical sync pulse, which helps 
the electronics recognize the first line of a new "frame" of imagery. 
The camera used in the simulation provides each of these logic signals 
on a separate wire. 

The video processing electronics first converts each pixel to an "on- 
or-off" signal. The effect io similar to a black and white television 
with the contrast very high; there are no shades of gray, only white 
and black or on and off. If the flash lamps are much brighter than the 
rest of the scene, this process leaves all the pixels "off" except fo^ 
the few that represent the image of the flash lamp. The electronics 
uses three counters and two adders to find the coordinates (column and 
line numbers) of the center of the cluster of "on" pixels. This center 
is called the center of brightness or "centroid," The "pixel counter" 
counts the number of "on" pixels, the "column counter" keeps track of 
the current column number, and the "line counter" keeps tirack of the 
current line number. Each time an "on" pixel is detected, the column 
and line adders add the values in the column and line counters to to- 
tals maintained in two data storage circuits called accumulators. 

After the "mage is fully scanned, the coordinates are found by dividing 
the values in the accumulators by the number of "on" pixels. 

When the camera starts to scan an image (Fig. VI-2), the adders and the 
pixel counter are all set to zero, the column counter is set to -103, 
and the line counter is set to +122. These starting values cause row 0 
and line 0 to be In the center of the frarar. During the scan, the col- 
umn counter counts from -103 to +93 for each line. The first pixel of 
the line is received when the count is -94, because there Is a delay 
between the end of one line and the start of the next. At the end of 
each line, the column counter is reset to -103, and the line counter 
counts down first to 121, then to 120, and so on to -121 at the bottom 
line of the image. 
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Delay 


Note : 

One of two "fields" is shown. Each field cc itains the same information. 
Within each field, pairs of lines contain the same information, so the 
effective vertical resolution is 122 lines. Columns -103 through -95 do 
not c itain video Information. 

Figure VI-2 Television Image Line and Column i Scheme 

Consider what happens if only three pi ..els in an image are "on,” and 
their (column, line) coordinates are (0,-2), (1,-2), and (2,-3). The 
system computes the average column by adding the three column numbers 
(0 + 1 + 2 = 3) and dividing by the number of pixels that were ''on.” 

The result is 3/3, or column 1. Similarly, it computes the average 
line by adding the three line numbers [( -2) + ( -2 ) + ( -3 ) * -7 ] 
and dividing by the number of "on" pixels: the average line number is 
(-7)/3 =* -2.333. 

The electronics itself does not perform the division. It just supplies 
the numerator and denominator to the simulation computer, and the com- 
puter performs the division. The electronics, therefore, has the sim- 
ple job of computing three totals: the sum of the column numbers, the 

sum of the line numbers, and the number of "on” pixels. It updates 
e ch of the three totals each time it receives an "on" pixel. 

In this example, the first "on" pixel is detected in line -2. The col- 
umn accumulator has 0 added to it, the line accumulator has -2 added to 
it, and the pixel counter is incremented by 1. At the next pixel, 1 is 
added to the column accumulator and -2 to the line accumulator, aud the 
pixel counter is incremented again. In the next line, 2 is added to 
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the column accumulator, -3 is added to the line accumulator, and the 
pixel counter is incremented a third time. Thus, at the end of the 
scou, the column accumulator contains 3, the line accumulator contains 
-7, and the pixel count is 3. Dividing the column and line values by 
the pixel count gives the average coordinates of the M on" pixels, 

(3/3, -7/3). In other words, column 1, row -2.333 is the location of 
the centroid. 


B. CIRCUIT DETAILS 


The hardware for the simulation consists of five major sections: 

1) The Prime 550 simulation computer; 

2) The video processing electronics; 

3) The computer terminal; 

4) The General Electric TN-2000 charge-injection device (CID) televi- 
sion camera; 

5) The 6-degree-of-f reedom simulator. 

The simulation computer sends servo commands to the simulator and con- 
trol signals to the video processing electronics. The camera sends 
video imagery and timing signals to the video electronics, which, in 
turn, sends its analysis of the imagery to the simulation computer and 
passes normal text from the computer to the terminal. The operator 
uses the terminal to type commands to the computer. The interconnec- 
tions are shown in Figure VI-3. 
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Figure ''VI-3 System Interconnections 
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Only the video electronics was designed for this contract; it is ex- 
plained here in detail. 

The video electronics comprises eight sections: 

1) Microprocessor; 

2 ) Synchronization with camera; 

3) Comparator; 

4) Counters; 

3) Accumulators; 

6) Multiplexer; 

7) Drivers; 

8) High-voltage flash box. 

At the hub of the communications between the video electronics and the 
simulation computer is an MC68701 microprocessor. Its job is to pass 
data between the computer and the terminal. It also intercepts data 
intended for the video electronics by recognizing special characters in 
the text. 

A separate section of the video electronics synchronizes the requests 
for action intercepted by the microprocessor with the start of a video 
image from the camera. 

A comparator conveys the video signal from analog to digital form. 

The reference voltage used in the comparison is generated by the simu- 
lation computer and varies during a simulation. The digital signal is 
"true" ("on") for a pixel in which a flash lamp is detected and "false" 
("off") when a flash lamp is not detected. 

There are three counters in the video electronics. The first counts 
the "on" pixels detected by the comparator. This is the "pixel" count- 
er. The second or "column" counter counts up one count for each pixel 
in a line, whether the pixel is "true" or "false." This count starts 
at a negative value so that a count of zero occurs in the middle of 
each line, negative numbers occur in the left half frame, and positive 
numbers occur in the right half. 

This third counter, or "line" counter, counts lines in the image. It 
starts counting from a positive value and counts down, so zero again 
occurs in the middle of the image. The count is positive for the top 
half of the frame and negative for the bottom half. 

The outputs from the column and line counters are fed through adders to 
two accumulators, which are clocked by a pixel-rate "count load" clock 
signal that is synchronized with the camera. They accumulate counts 
from the column and line counters each time the comparator detects a 
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pixel with voltage exceeding a "threshold” value; the count in the 
column counter is added to the column accumulator, and the count from 
the line counter is added to the line accumulator. Because pixel volt- 
age normally exceeds the threshold only for pixels that represent the 
image of a flash lamp, the circuitry calculates the number of pixels 
that are in the image of the lamp, the sura of the row numbers, and the 
sum of the column numbers for these pixels. 

After a flash has occurred, data from the pixel counter, the column 
accumulator, and the line accumulator are fed to a multiplexer. The 
output of the multiplexer goes to differential drivers, which send 
these data to the simulation computer. 

The high voltage flash box contains the voltage doublers and trigger 
circuit to fire the xenon flash lamps. The interconnections among 
these sections are shown in Figure VI-4. 


Serial Data 



Figure VI-4 Interconnections within Processing Electronics 


1. Microprocessor 

The microprocessor examines the data sent from the simulation comput- 
er. If the data are intend-'* for the operator, the microprocessor 
sends them to the terminal. If the data are for the video electronics, 
the microprocessor intercepts and directs them to the electronics. 

This is accomplished by preceding the data for the electronics with an 
ASCII "escape” character. The microprocessor checks every character 
sent by the computer. T f the character is not an escape, the micro- 
processor sends it to the termiual. If an escape is detected, the next 
character received is sent to the electronics through the microproces- 
sors parallel output port, P4. Port 2, bit 3, is used as a serial 
input port from the computer, and port 2 f bit 4, is used as a serial 
output port to the terminal. An MC1488 and MC1489 convert between 
logic circuit voltage levels and RS-232C levels so that the simulation 
computer can communicate with the microprocessor. The configuration is 
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All eight bits of the PA port are used. The assignments shown in 
Table VI-1. The signal names will be explained as their destinations 
are discussed. 


Table VI- 1 

Uses of Bits on Port P4 


Bit Number 

Signal Name 

0 

ONE 

1 

TWO 

2 

THREE 

3 

REQ 

4 

NEXT 

5 

ZERO 

6 

CMUX 

7 

GOTIT 


The microprocessor circuitry is shown on Sheet 1 of the schematic dia- 
grams in Appendix B, and the firmware for the microprocessor is pre- 
sented in Appendix C. 

Synchronization 


There are several asynchronous events that must by synchronized in 
order tor the data to be valid: 

1) Start: 

Start of a frame of video imagery, 

Request for a lamp to flash. 

2) Middle : 

Counters, 

Comparator. 

3) End: 


Last load, 

Data valid, 

Reset arithmetic/logic unit, 

Change multiplexer, 

Reset multiplexer. 

The video picture consists of two half frames or fields, which are in- 
terlaced to create the picture. In a broadcast-quality camera, these 
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fields are slightly different: the first field contains the odd-num- 

bered lines of a 488-line image, and the second field contains the 
even-numbered lines. The phasing between the horizontal and vertical 
sync pulses is different for the two fields: the horizontal pulses in 

the second field are delayed by half the time required to scan a line 
so that a television set will "paint" the lines of this field between 
the lines of the first field. However, the camera used in the simula- 
tion does not have the resolution of a studio camera. It has only 122 
lines of detector elements and must rescan each line to create a 
244-line field. To create a second field, it repeats the first field 
with the half-line delay to simulate scan interlacing. This makes the 
camera compatible with a standard television signal, but the second 
field contains no information that was not in the first field. Because 
all the information is contained in each field, the video electronics 
uses only the first field. 

3. Start Synchronization 


To ensure that the same half frame is used in each image analysis, a 
singleshot is used to shorten the vertical sync pulse from the camera. 
The shortened pulse is "ANDed" with the horizontal sync pulse. When 
the start of a frame occurs, the "ANDed" signal goes high. This signal 
is inverted and used to set a 74279 set-reset latch. The latch is 
cleared on the next occurrence of a vertical sync pulse. The setting 
of the latch is prevented during the start of the second half frame by 
the shortening effect of the singleshot (Figure VI-7). The result is 
that the electronics will always wait for the proper half frame. 


( 1 ) 

Vertical Sync 

( 2 ) 


_r 



Shortened 
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(3) 
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(4) 

Signal (2) 
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n ns 
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(b) Second Half 






Frame 


Figure VI-7 Timing of Signals Used to Identify First Field 

The request for flash must also be synchronized with the start of a 
frame. There are five signals associated with the flash request. Four 
of these are the flash lamp numbers 0 to 3 (0 indicates "no flash”), 
and the fifth is a "flash request.” These five signals come from the 
microprocessor, which receives them from the simulation computer. The 
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flash request is delayed by a singleshot and then used to latch the 
flash lamp numbers into the "flash latch," Only one lamp number is 
active (high) at a time. The outputs of the flash latch are sent to 
four two-input AND gates. The other input to the gates comes from the 
"ANDed" start-of-f rame signal. The outputs from the AND gates go to 
drivers, which send the signals to the high-voltage flash circuit for 
the flash lamps. The AND gate outputs also go to two OR gates and an 
"exclusive OR" gate. The output of the exclusive OR sets the circuitry 
of counters and accumulators into action by triggering a singleshot 
whose output sets a count latch and clears the flash latch. 

4. Middle Synchronization 

The column counter and the line counter must be synchronized with the 
camera. This synchronization requires two logic signals sent from the 
camera, the column clock and the line clock. These signals increment 
the column counter and decrement the line counter, respectively. Be- 
cause these signals are active even when they are not needed, the load 
signals CCNTLD and LCNTLD are used to control them. CCNTLD, the signal 
resulting from "ANDing" the count latch arl the horizontal sync, pre- 
sets the column counter at the start of each line and disables the 
counter when a flash is not in progress. LCNTLD, the the count latch 
signal "ANDed" with the vertical sync, presets the line counter at the 
start of each frame and disables the counter when a flash is not in 
progress. 

A comparator compares the video signal and a reference voltage. The 
output of the comparator is a logic signal that is zero when the video 
signal is above the reference voltage. This signal is inverted and 
disables the reset on a pixel latch. The set signal to set the latch 
comes from the column clock. The output of the pixel latch is put into 
an inverter with a capacitor and an AND gate. The configuration of 
latch, inverter, capacitor, and AND gate prevents multiple counts or 
missed counts of thresholded pixels. The output of the AND gate is 
"ANDed" with the output of the count latch to produce a load pulse. 

This pulse increments the pixel counter and loads the column accumula- 
tor and line accumulator with the current values in the column and line 
counters, respectively. This occurs every time the video contains a 
pixel with voltage that exceeds the reference value. 

5. End Sync 

After half a frame, the vertical sync occurs, and a number of events 
occur : 

1) The count latch is cleared, which causes 

2) The signal DATACLK to clock the final data into the output regis- 
ters of the accumulators and pixel count register; 

3) "DATA VALID" is set; 

4) After a delay through a singleshot, the signal RESET ALU becomes 
low. 
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The simulation computer waits for the data valid signal after Issuing 
the request for a flash* When the data are valid, the count of pixels 
is read. The computer then issues a NEXT command to the microproces- 
sor, which passes it on to the multiplexer address counter. The count- 
er increments and the outputs of the counter are used to select the 
next inputs for the multiplexer. Then the data in the column accumula- 
tor are read by the computer. NEXT is issued again, and the line data 
are read. NEXT is issued one more time to: 

1) Clear the accumulators; 

2) Clear the pixel counter; 

3) Clear ’‘DATA VALID.” 

Finally, CMUX is issued to reset the multiplexer address counter for 
the next sequence. 

Throughout the flash sequence, the signal "GOTIT” is toggled for each 
request from the computer. This signal is produced by the computer and 
is fed back to the computer to establish bidirectional handshaking be- 
tween the video electronics and the computer. 

6 . Comparator 

The comparator, an LM319, compares the video signal to a reference 
voltage from dig! tal-to-ani Log converter channel 8 of the simulation 
computer. Because the voltage has a +7-10 volt range and the video 
signal cannot exceed one v>lt, the reference voltage is divided by two 
resistors to produce a range of +/-1 volt at the comparator. 

7. Counters 


The three counters are 74LS169 , s. The column counter counts from -103 
to +93. The line counter counts from 122 down to -121. Only eight 
bits are reo M, red to count in these ranges, so two 74LS169's were used 
for each coui. cr. The pixel counter must be able to count every pixel 
if all arc above the reference voltage. Because there are 188 pixels 
in a line and 244 lines, 45,872 is the maximum count for this counter. 
Five 74LSib9*s were used for the pixel counter to allow for possible 
future use of both video fields. 

8. Accumulators 


The counts in the column and line counters must be accumulated every 
time the comparator detects an "on" pixel. Because the counts may be 
either positive or negative, the greatest possible total would accumu- 
late if half the columns and half the lines were counted. This is a 
count of 122 columns and 94 lines. Counting every pixel for this case 
yields a total possible count of 1,089,460 for the column accumulator 
and 110,564 for the line accumulator, or 22 bits and 21 bits, respec- 
tively, Including the sign bit. To meet this requirement, six AM2517 
four-bit arithmetic/logic units (ALU) were combined with three 74LS377 
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registers to make a 24-bit adder-accumulator. The signal "RESET ALU" 
controls the ALU function: if a reset is to be performed, the function 

is "F=0"; otherwise the function is "A+B". The data from the counters 
are added into the A inputs with the sign bit extended. The output of 
the 74LS377 registers is fed into the B inputs and into the inputs of 
the data multiplexers. 

9. M ultiplexers 

A four-input multiplexer, comprising twelve 74LS153 dual four-input 
multiplexer chips, selects the data to be sent to the computer. Table 
VI-2 shows the select codes that control the multiplexer. 


Table VI - 2 Multiplexer Data Addressing 


Control Code 

Data Sent to Simulation 
Computer 

00 

Pixel Count 

01 

Column Accumulator 

10 

Line Accumulator 

11 

(Unused) 


A 74LS169 counter is used to select the multiplexer. It is controlled 
by the NEXT and CMUX outputs of the microprocessor. The NEXT data line 
clocks the counter, and the CMUX line either enables the counter to 
count or loads a zero to reset it. 

10. Drivers 


The data from the multiplexer are sent to twelve 8830 dual differential 
drivers that send the data to the computer. A thirteenth 8830 is used 
to send DATA VALID and GOTIT to the computer. 

1 l • High-Vo l tage Flash Box 

The flash lamps used are xenon bulbs, which require an anode voltage 
between 200 and 400 volts. The circuit to supply this voltage and 
trigger the lamps is shown in Appendix B. For safety, the circuit is 
isolated from the power line with an isolation transformer. A voltage 
doubler and peak detector convert the isolated 115 volts ac to 300 
volts dc, the anode voltage for the lamps. 

A voltage divider is used to derive 170 volts dc from the 300 volts to 
charge a 0.25 pf capacitor. A silicon w mtrolled rectifier (SCR) is 
wired across the capacitor and a trigger coil, which has a 30:1 turns 
ratio. When the flash request is sent, the SCR shorts the capacitor 
and coil, producing a high trigger voltage to flash the lamp. 
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During the simulation, the 6-DOF simulator adjusts the position and 
attitude of the simulation television camera so that it will have the 
same view of the target as a camera mounted on a real chase vehicle. 

The simulator servos are commanded to new positions and are allowed to 
settle before each flash of the docking aid lights. Because the camera 
makes no observations between flashes, it was not necessary to simulate 
continuous motion. 

The main subroutine for simulator control is POINT. The subroutine 
calls two others to calculate the required translational and rotational 
position of the camera. A third subroutine converts these commands 
from units of meters and radians to servo command voltages. This rou- 
tine also verifies that the requested position can be reached and cal- 
culates how long the servos will take to settle at the new position. 

It then sends the voltages to the servos through digital-to-analog 
converters. 


A. SUBROUTINE SIMXLT COMPUTES TRANSLATIONAL POSITION 

Subroutine SIMXLT determines where the camera should be positioned by 
evaluating the formula 

[37] c = l. + A (A. fsx + A t (sh - JL )1 - sh.) , 

1 J — — ts st t[ “ c — c — lens' J — t 


where 

£, represented in the program as SIMXYZ, is the position of the camera 
in the simulator's coordinate system; 

4s. represented in the program as LTS, is the position of the dock- 
ing aid on the target model, expressed in the simulator coordinate 
system; 

A st , represented in the program as AST, is the direction cosine ma- 
trix that describes the simulator's attitude with respect to the target 
model; 

A t , represented in the program as AT, is the direction cosine matrix 
that describes the target's attitude with respect to the "truth" coor- 
dinate system; 

s, represented in the program as SCALE, is the model scale (0.01, 0.1, 
or 1.0); 
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x, represented in the program as the first three elements of the array 
TTATE, is the chase vehicle's position in the "truth" coordinate system; 

f represented in the program as TRNACV, is the transpose of the 
direction cosine matrix that describes the chase vehicle's attitude 
with respect to the "truth” coordinate system; 

£i pns represented in the program as LLENS, is the offset from the 
center of the simulator's gimbal set to the effective center of the 

camera lens; 

h c and h t , represented in the program as HC and HT, are the posi- 
tions of the camera and docking aid in the coordinate systems of the 
chase vehicle and the target, respectively. 

The values of s, A st , A tg , and i lens are constant within a simu- 
lation phase, but change between phases. The variables A t , A^ 
and x change as the simulated spacecraft move. The vectors h r and 
h t depend only on the design of the two spacecraft and do not change. 

Figure VII-1 illustrates the physical interpretation of Eq 37. 
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Subroutine SIMROT computes the attitude of the chase vehicle with re- 
spect to the target spacecraft and then finds a set of gimbal angles 
that will give the camera the same attitude with respect to the target 
model. However, the problem is more complicated than it might appear. 
First, the target model is not aligned with the simulator coordinate 
system. We pointed the docking axis of the model slightly upward in 
order to use the operating range of the simulator to best advantage. 
Second, the gimbal set is pitched down 45 degrees when all gimbal 
angles are zero. Mounting the gimbal set this way allowed us to oper- 
ate with the small target models against the wall of the room and the 
large model on the floor without encountering singularities or servo 
limits in normal operation. 

To account for these factors, the subroutine calculates 


[38] 


A = 


A A^A^ 
cv t ts 


where 

A, represented in the program as A, is a direction cosine matrix that 
describes the attitude of the camera with the required gimbal angles 
relative to its attitude with zero gimbal angles; 

A cv , represented in the program as ACV, is a direction cosine matrix 
that describes the chase vehicle attitude with respect to the "truth" 
coordinate system; 

a£, represented in the program as TRNAT, is the transpose of the 
direction cosine matrix that describes target spacecraft attitude with 
respect to the "truth" coordinate system; 

A ts ', represented in the program as ATSP, is the direction cosine 
matrix that describes the attitude of the target model with respect to 
the camera's zero-gimbal-angle attitude. 

Because the gimbal set provides a yaw-pitch-roll sequence, it can pro- 
duce the attitude change specified by the matrix A as long as A ct j " 
match the general sol tion of a yaw-pitch-roll direction cosine matriA 
element for element with realizable values of the gimbal angles. The 
general yaw-pitch-roll solution is 




cPcY 

cPsY 

-sP 

[39] 

A 3 

sRsPcY - cRsY 

cRcY 4* sRsPsY 

sRcP 



sRsY + cRsPcY 

cRsPsY - sRcY 

cRcP 
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where Y, P, and R are the yaw, pitch, and roll gimbal angles, and c and 
s are abbreviauions for sin and cos. Ordinarily, 


[40] Y = ATAN2 (a 12 ,a n ); 

ORIGINAL PAGE 13 
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[41] R = ATAN2 (a 23 ,a 33 ); 
and either 

[42] P - AIAN2 (-4,3.^) , 
or 

[43] P . ATAN2 (-413.^) • 

where ATAN2 is the FORTRAN two-argument arc tangent function. However 
alternate formulas must be used if there is a singularity. For exam- 
ple, if an and a 12 are both zero, Eq 40 cannot be evaluated. Sim- 
ilarly, Eq 41 cannot be used if a 23 and 333 are both zero, and Eq 
42 cannot be used if cos(Y) = 0 or ’ Yth an and a ^3 are zero. 

When the problem is simply that sin(Y) or cos(Y) is zero, the subrou- 
tine has no problem, because cos(Y) can never equal zero at the same 
time sin(Y) equals zero. The subroutine selects either Eq 42 or Eq 43 
depending on whether an or a ^2 has larger absolute value. 

The problem is more complex when there is a singularity, because there 
is no unique solution. To select among the infinite nurauer of possible 
solutions, the subroutine adds the constraint that the new gimbal 
angles should match the current angles as closely as possible. The 
choice of this rule was arbitrary, but it does reduce the time required 
for the servos to settle to their new positions. 


C. SUBROUTINE SERVO SENDS COMMANDS TO THE SIMULATOR 


Subroutine SERVO receives the translational commands in meters and the 
rotational commands in radians and checks to see if any command exceeds 
the ranre over which the servos can operate. The program halts any 
time a servo is not able to position the camera where i should be. 


* 
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If all the commands are legitimate, the subroutine uses empirical for- 
mulas to calculate the command voltages for the servos. Using a table 
of servo slew rates, it computes the time it will take for all the 
servos to settle to their new positions. It adds this interval to the 
time read from the computer's real-time clock and stores the result in 
the common block SRVOTM so that the subroutine that flashes the lights 
can determine when it is cafe to do s*«. 

Finally, the subroutine transmits the new servo commends through six 
digital-to-analog converter ports on the simulation computer. 
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APPENDIX A — PROGRAM LISTING 


The program listing in this appendix is provided to document the simu- 
lation methods used to analyze the three-light video guidance system 
and to run the physical simulation. It was written to run on a Prime 
550 computer under the PRIMOS operating system, but has few hardware- 
dependent subroutines. If it is to be run on another computer, the 
following information will prove useful: 

1) Several library routines are used, which are net sh n in the list- 
ing. The routines include ASIN and ACOS, which compute the inverse 
trigonometric functions arc sine and arc cosine. The function 
RANFN is a random number generator that computes normally distri- 
buted random values with a specified mean and standard deviation. 
The routines DINA, DINB, and DINC are digical input port interface 
routines, and the routine INITDI initializes the digital input 
ports. In addition, the matrix arithmetic routines MADD (addi- 
tion), MSUB (subtraction), MMLT (multiplication), MINV (matrix in- 
version), MSCL (multiplication by a scalar), MIDN (setting an array 
equal to the identity matrix), and MTRN (forming the transpose of a 
matrix) are used from the Prime library MATHLB. 

2) File handling may present conversion problems even if the program 
is to be run on another Prime 550 computer, because logical unit 
numbers, file names, and amount of disk storage vary from installa- 
tion to installation. Standard Prime subroutines are used to open 
and close files. These subroutines (TSRC$$, EXST$A, CL0S$A, and 
DELF,$A) are from the Prime library APPLIB. 

3) Run time is approximately one-sixth of real time if the computer is 
dedicated to one user. The servo settling time is the primary fac- 
tor affecting speed. 

4) The perspective drawings shown in this report are not created di- 
rectly by this program. They are drawn by a second program that 
uses the data file created by this program. This allows the crea- 
tion of stereo plots and views from different perspectives. 

5) Several WRITE statements in subroutine DOCK are rendered inactive 
by a character C in the first column of text. Removing this char- 
acter will provide a printout at the operator’s terminal for moni- 
toring the progress of the simulation. 

The first part of the listing is the text of a terminal session, which 
includes compilation, loading, and execution of the program. 
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APPENDIX B-- -SCHEMATIC DIAGRAMS 


The diagrams provided in this appendix are for the video processing 
electronics described in Chapter VI. Reference designators of the form 
El, A12, C9, etc identify the column and row on the wire-wrap card 
where pin one of an integrated circuit is located. 
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APPENDIX C — MICROPROCESSOR FIRMWARE 


The program listing in this appendix is the program executed by the 
microprocessor on one of the video processing electronics circuit 
cards. The program flow chart is shown in Figure VI-6. The program's 
function is to intercept commands intended for the video processing 
electronics from the data stream between the computer and the opera- 
tor's terminal. The commands are characters preceded by an ASCII "es- 
cape" character. When an escape character is received, the microproc- 
essor sends the next character it receives to its parallel output port 
P4. All other characters are relayed to the terminal. 
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